26. Wrap Up

In this lesson we reviewed the FFNN and its training process. We dove into RNNs, understanding the motivation behind them, when they are used, and how are they designed. We also learned how to train them using BPTT. We reviewed current applications, such as machine translation, and gave intuition to why so many other applications use RNNs, and in particular LSTMs.

Next, Luis will guide you through the LSTM architecture.